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The Schottky problem is the problem of finding necessary and sufficient conditions for a principally 
polarized abelian variety (ppav) to be a product of jacobians of smooth curves. 

Let [P, S) be a ppav of dimension p > 4 with S a symmetric theta divisor on P. The elements of 
r = H^{P, 2H) are symmetric, hence their multiplicities at the origin are always even. Let Fq C F be 
the subvector space of F of sections with multiplicity at least 2 at the origin and let Fqo C F be the 
subvector space of sections with multiplicity at least 4 at the origin. Also let |2S|oo C |2H|o C |2S| 
be the linear systems of divisors of zeros of elements of Fqo C Fq C F respectively. It is well-known 
that the dimensions of F, Fq and Fqo are respectively 2^, 2^ — 1 and 2^ — 1 — Ml^hi) (for this last we 
need (P, H) to be indecomposable, see Hgf page 188 Lemma 11 and [|GG|| Proposition 1.1 page 618). 

We have the linear map 

r4:Foo-^i/°(PToP,OpTop(4)) 
defined by sending a section s G Fqo to the quartic term of its Taylor expansion at the origin. Let 
Qoo denote the linear subsystem of |Cptop(4)| which is the projectivization of the image of r4. Let 
Voo and Vinfflo denote the base loci of |2S|oo and Qoo respectively. In [ pm , van Geemen and van 
der Geer proposed a characterization of the locus of jacobians, made more precise by Donagi ( [pol|] 
page 110), in the following form: 

Conjecture 1. I- If {P, 5) = {JC, 0) is the jacobian of a smooth curve C of genus g, then Vqo 
is set-theoretically equal to the reduced surface C — C := {Oc{s — t) : s,t G C}. 
2. // (P, S) is not in the closure Jg of the locus of jacobians in the moduli space of ppav of 
dimension g, then Vqo = {0} set-theoretically. 

Beauville and Debarre proposed an infinitesimal version of Gonjecture |T] ( [ [BD| ) : 

Conjecture 2. 1. // (P, S) = ( JC, 0) is the jacobian of a smooth curve C of genus g, then 
^n/,00 is, set-theoretically, the canonical image kC of C in \oJc\* = "PToJC where ujc is the 
dualizing sheaf of C (note that nC is the projectivized tangent cone to C — C at 0). 
2. // (F, S) is not in Jg, then l^„/,oo empty. 

The first parts of Gonjectures |l] and § have been proved (each with one well-determined exception) 
by Welters |[W1|| , the author ||Izl|| and Beauville and Debarre [[BD|| . In |p!zl|| , we also determined the 
scheme-structures of the base loci for jacobians. In |Iz2|, Theorem 4 page 95, we proved the second 
parts of Gonjectures |1| and in the case p = 4. Beauville, Debarre, Donagi and van der Geer proved 
part 2 of Gonjecture |1| for intermediate jacobians of cubic threefolds, the Prym varieties of "even" 
etale double covers of smooth plane curves (see ||BDDG|| ), and Beauville and Debarre proved parts 
2 of Gonjectures ^ and |^ for certain ppav isogenous to a product of p elliptic curves (see | |BD|| pages 
35-38). By semi- continuity, one deduces from this last result that for a general ppav Vqo is finite 
and Vinf, 00 is empty. 

Let Ap be the moduli space of ppav of dimension p. In [Iz2 
Gonjectures |I| and ^ for p = 4 by using the fact (proved in | [lz2 



we proved the second parts of 
Theorem 3.3 page 111) that an 

element of A4 \ J/^ is always the Prym variety of an etale double cover of a smooth curve of genus 
5. From now on we will suppose that (P, S) is the Prym variety of an etale double cover of smooth 
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curves n : C ^ C with C non-hyperelliptic of genus g = p + 1. Then (P, S) is indecomposable, i.e., 
it is not the product of two positive-dimensional ppav (see [[M2|| page 344, Theorem(d)). There is 
a natural analogue of the surface C — C for a Prym variety, namely, the reduced surface 

S := S(7r : (7 ^ C) := {0^{s + t - as - at) : s,t e C} C P C JC , 

where a is the involution of the cover n : C C. Let e : P ^ P he the blow up of P at with 
exceptional divisor S and let S be the proper transform of S in P. Let L be the linear system 
|e*(2S) — AS\ on P. When g = 5 there is an involution A acting on the moduli space of admissible 
double covers of stable curves of genus 5 such that a double cover C —>■ C and A(C — > C) have 

pages 119 and 126). Furthermore, for any 



see 



Do2| page 100 and |lz2 



the same Prym variety 

fixed (F, H) G ^4 \ J74, there is an etale double cover C ^ C of a smooth curve C such that 
{Cx — > Cx) '■= X{C — > C) is also an etale double cover of a smooth curve Cx (see [|lz2|| page 136). 
In such a case, put Sa := S(C'a Cx) and let Sa be the proper transform of Sa in P. With these 
hypotheses, we proved in [[lz2|| that (recall g — 1 = p = 4) 

• there is exactly a pencil of elements of L containing E (see ||lz2|| , 5.7 page 134 and 6.23 page 
148), 

• the base locus of this pencil is equal to S U Sa as a set, as a scheme if (C — > C) 7^ {Cx Cx) 



(follows from [Iz2 



5.7 page 134), 

• the base locus of the restriction L|g is empty ( ||Iz2|| pages 139 and 146-147). 

We generalize this third result to higher dimensional Prym varieties and give bounds for the dimen- 
sion of the sublinear system of L consisting of elements containing S: 

In Section ^ we prove 

Theorem 3. // C is neither trigonal nor hyperelliptic of genus 
empty. 



> 5, then the base locus of L|g is 



For C trigonal, the Prym (P, H) is a jacobian and the support of the base locus of Llg is easily 
determined (see Proposition and Remark |4.3| below). 

To prove the Theorem, we use divisors in the linear system |2S|oo which are obtained as inter- 
sections with P C JC of translates of the theta divisor 9 of JC (see Section |] below). To our 
knowledge such divisors have not been used before in the litterature. 

The Prym-canonical curve xC is the image of C in \ujc a|* by the natural morphism C — > 
\uJc' ® a|* where a is the square-trivial invertible sheaf associated to the double cover n : C ^ C. 
Under the natural isomorphism PTqP = \ujc ® a\*, the curve xC is the tangent cone to S at 0. 
Therefore the Theorem implies 

Corollary 4. Suppose that C is neither trigonal nor hyperelliptic, then 

1. the only base point of |2S|oo on S is 0, 

2. the linear system Qoo has no base points on xC. 

Our approach leads us to consider the vector space Fqq := {s G Poo : s|e = 0} with projectiviza- 
tion |2S|qq := {D G |2S|oo : D 3 S}. Then |2S|qq can be identified with the sublinear system of 
elements of L containing S. Let Qqq be the linear subsystem of Qoo consisting of quartic tangent 
cones at to elements of |2H|qq. On a Prym variety, second order theta divisors which contain S 
can be thought of as natural generalizations of 26-divisors on JC containing C — C. It is well- 
known (see [0] Theorem 2.5 page 120 and [GIT^] page 265 or | Wl] Proposition 4.8 page 18) that, 
on a jacobian (JC, O), a 20-divisor contains C — C if and only if it has multiplicity at least 4 at 
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the origin. This does not generahze to Prym varities: Corollary ^ implies that |2S|qq and Qqq are 
proper linear subsystems of |2S|oo and Qoo respectively. More precisely, we prove (see Section |): 

Proposition 5. Suppose C non-hyperelliptic. The dimension o/Fqq is at most 2^ — 4 — ^p{p + 1) 
and at least 2^ — 2 — p{p — 1). The codimension of Qqq in Qoo is at least 2. 



Note that when p = A, we have another proof of the result of [[Iz2|] saying that the dimension of 
|2S|qq is 1. We pose 

Conjecture 6. Suppose that [P, S) is not a jacobian. Then 

1. the base locus Vqq of |2S|qq is as a set if p > 6, 

2. the base locus V-^jqq of Qqq is xC as a set if p > 6. 

By Corollary ^, this conjecture implies the second parts of Conjectures |l] and ^ for Prym varieties. 
We have the following evidence for this conjecture: 

Results of Welters and Debarre ( [[W2|| and |Pe|| , see Section |l| below) imply 

Proposition 7. The base locus Vqq is the set-theoretical union ofT, and, possibly, some curves and 
points for a general Prym variety of dimension p > 16. 

Combined with Corollary ^ this implies: 

Corollary 8. // (F, H) is a general Prym variety of dimension > 16, then Vqo has dimension < 1. 

Results of Debarre imply (see Section |l]) 

Proposition 9. Por a general Prym variety of dimension p > 8, the base locus V^'„joo ^■^ s^^' 
theoretically equal to xC. 

Combined with Corollary ^ this implies (see Section [l| below) 

Corollary 10. Part 2 of Conjecture |^ is true for general Prym varieties of dimension p = g — 1 > 8. 

We explain why we make Conjecture ^ only for p > 6 and only set-theoretically. Let TZg be 
the space parametrizing etale double covers C ^ C where C is a smooth non-hyperelliptic curve 
of genus g = p + 1. The Prym map is the morphism TZg — > Ap which to a double cover C — > C 
associates its Prym variety. Recall (see above) that in case p = 4, we proved in |P!z2|| (5.7 page 134) 
that Vqq = E U Since the Prym map is generically injective for > 7 (see |FS|] ), we expect 
that Vqq = E as sets. Now an argument analogous to [[lzl|| (2.9) page 196 shows that, if V^'q = E 
as sets, then V^'q is not reduced at and hence is not equal to E as a scheme. If the morphism 
p : C^'^^ E, where C^"^^ is the second symmetric power of C, is birational, then, by analogy with 
the case of jacobians (see ||Izl|] ), we can expect ^e reduced at the generic point of E. If, on the 

other hand, the morphism p is not birational, then, by a standard semi-continuity argument, the 
scheme Vqq is not reduced anywhere on E. Note that, using a refinement of a theorem of Martens by 
Mumford ( |[ACCII|| Theorem 5.2 page 193), one can easily see that if C is neither bielliptic, trigonal, 
nor a smooth plane quintic, then p is birational. Similarly, we can expect V"/„j qq to be equal to xC 
as schemes if C = xC but V/^^ qq will not be equal to xC as a scheme if the morphism C xC is 
not (at least) birational. 

On the other hand, Donagi and Smith proved (see [pS|| ) that the generic fibers of the Prym 
map have cardinality 27 when g = 6 and Donagi proved (see |po2|| Theorem 4.1 page 90) that the 
Galois group of the Prym map is isomorphic to the Galois group of the 27 lines on a cubic surface. 
So there could be nontrivial automorphisms acting in the fibers of the Prym map. If there is an 
automorphism p : TZq —>■ TZq acting in the fibers of the Prym map, then one would expect V^g to be 
the union of E = E(C' —>■ C) and the surfaces E(/x(C' C)), E(/x^(C* C)), etc. 
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Notation and conventions 
All varieties and schemes are over the field C of complex numbers. 

For any section s of an invertible sheaf £ on a variety X, denote by Z{s) the divisor of zeros of 
s. Let h^{X,C) denote the dimension of W{X,C). 

For a divisor D on C (resp. C), denote by (D) the span of D in the canonical space of C (resp. 
C). 

1. Preliminaries 

Let TT : C — s> C be an etale double cover of a smooth non-hyperelliptic curve C of genus g. Let a 
be the point of order 2 in Pic^C associated to the double cover vr so that we have tt^O^ = Oc © a. 
Choose an element /3 of Pic^C such that /?®^ = a and a theta-characteristic k on C such that 
h^{C,K) and h^{C,n*{K /?)) are even. Symmetric principal polarizations on JC = Pic^C and 
JC = Pic^C can be defined as the reduced divisors 

Q:={De Pic^C : h\C, D ® n* {k ^ /3)) > 0} 

e := {D e Pic^C : D®k)>0}. 

With these definitions, the inverse image of O by the morphism tt* : JC —>■ JC is the divisor 
0/3 + 0/3-1 where 6/3 is the translate of O by (3. The Prym variety (-P, S) of the double cover 
TT : C C is defined by the reduced varieties 

P:={Ee Pic^C : Nm{E) ^ Oc, h^{C, E ^ it* {k ^ (3)) = mod 2} , 

E:={EeP: h^{C, E®tt*{k® /?)) > 0} 

where Nm : PicC —>■ PicC is the Norm map (see | |M2| | pages 331-333 and 340-342). As divisors we 
have 2S = P.0. Also define 

P' := {E G Pic^^-'^C ■ Nm{E) = uc, h\C, E) = mod 2} 

and 

E' := {EeP' : h^{C,E) > 0} . 

For any E E P', put 

EE:={DeP:D0EeE'}. 
Since Nm{E) = uc, we have U7^<S)E~^ = a*E. By the theorem of the square, the divisor EE + '^a*E 



is in the linear system \2E\ and, by Wirtinger Duality (see |[M2|] pages 335-336), such divisors span 
|2S|. Furthermore, ii E E E', then Ee + '^a*E is in |2S|o and such divisors span |2S|o (by Wirtinger 
duality, the span of such divisors is the span of (;/>(S) where : P — |2H|* is the natural morphism, 
this span is a hyperplane in |2S|* which can therefore be identified with |2S|o by Wirtinger duality, 
also see |[W1|| page 18). 

We now explain how Proposition ^ follows from results of Welters and Debarre and how Propo- 
sition ^ follows from results of Debarre. In this paragraph only, suppose that {P, E) is a gen- 
eral Prym variety. Then E is an element of the singular locus SingiE') of E' if and only if 
h^{C,E) > 4 ( ||W2 | page 168). Therefore, for every E G SingiE') and (p, (7) € C^, we have 



IS 



hP{C,E ® O^ip + q — ap — aq)) > 0. Hence T, G Ee and Ee + '^a*E is in |2S|qq. Since E 
symmetric, the tangent cones at to H^; and are equal. It follows from these facts and the 
irreducibility of Sing{E') for p > 6 (see [ pe|| Theoreme 1.1 page 114) that V^q is set-theoretically 



contained in r]EeSingCE')'^E and V-^j qq is set-theoretically contained in the intersection of the tangent 
cones at to S^; for a point of multiplicity 2 on E'. This latter can be rephrased as: V-^^ qq is 
set-theoretically contained in the intersection of the tangent cones to E' at its points of multiplicity 
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2. It is proved in |[W2|| (Theorem 2.6 page 169) that, for p > 16, the intersection r\EeSing{s')'^E is 



the set-theoretical union of S and, possibly, some curves and points. This proves Proposition 0. 
By |Pe|| Theoreme 1.1 page 114, the tangent cones to S' at its points of multiplicity 2 generate the 



space of quadrics containing xC for p > 6 and, for p > 8 (see ||De|| Corollaire 2.3 page 129, also see 



and ||LS|| ), the Prym-canonical curve xC is cut out by quadrics. This proves Proposition 

2. Pull-backs of divisors to 
Let p : & ^ P d JC be the morphism 

p : (s, t) I — > [s, t] := 0^{s + t — as — at) 

so that S is the image of by p. The morphism p lifts to a finite morphism p : — h>E C P. We 
have 

Lemma 2.1. For any i? G S' snc/i t/iat h^{C, E) = 2 and \E\ contains reduced divisors, the inverse 
image o/Se in is the divisor 

P*Ee = D^,e + A' 

where De is the reduced divisor 

De := {{p, q) : h\C , E ® 0^{-p - q)) > 0} 

and A' is the "pseudo-diagonal" of & , i.e., the reduced curve A' := {{p,ap) G C^} = p~^{0). 

Proof : We have the equality of sets 

P*Ee = {{p,q):E(^ [p, q] G S'} = {{p, q) : h\C , E ® [p, q]) > 0} . 

First suppose that \E\ has no base points. By ||M1|| (page 187, Step II and its proof), for any 
p G (7, we have h^{C,E (g) Oq{p — ap)) = h^{C,E) — 1 if crp is not a base point of \E\ and 
hP{C,E (g) 0^,{p — ap)) = h'^{C,E) + 1 if (xp is a base point of \E\. Since \E\ has no base points 
and h°{C, E) = 2, we have h^{C, E ® 0^.{p - ap)) = 1 for all peC. Similarly, h^{C, E » [p, q]) = 
h^{C,E®0^{p- ap)) - 1 = if crq is not a base point of \E®0^{p-ap)\ and h^{C,E®[p,q]) = 
hP{C, E Oq{p — ap)) + 1 = 2 if erg is a base point of \E (g) Oq{p — ap)\. Let D^p be the unique 
divisor of \E\ containing ap, then D^p + p — ap is the unique element of \E ® 0^{p — ap)\. So, to 
obtain hP{C, E (g) [p, q]) > 0, we need aq to be a base point of \E ® Oq{p — ap)\, i.e., the point aq 
appears in Do-p + p — crp. Therefore, either aq = p or h^{C , E ^ O^l—ap — aq)) > 0. So the support 
of p*Ee is D„*E U A'. 

An easy degree computation on the fibers of over C by the two projections shows then that 
P*Ee = Dcj*E + A' as divisors. 

If has base points, then its base points are distinct because \E\ contains reduced divisors. 
Then, by [pH|| page 287, the cohomology class of D(j*e is the same as in the case where \E\ has no 
base points. Hence, since p*Ee = D„*e + A' as divisors in the case where \E\ has no base points, we 
see that p*Ee — A' and D^-'e have the same cohomology class. Since the support of D^-'e is clearly 
contained in the support of p*Ee — A' and these are both effective divisors, they are equal. □ 

Remark 2.2. Suppose that E as above can be written as E = n*M ® 0^{B) where B is the base 
divisor of E and M is an invertible sheaf on C with h^{C,M) = 2. Then Dcr*E = A' + D' for 
some effective divisor D' . Therefore p*Ee = D' + 2A' which agrees with the fact that in such a case 



E G SingiE!) so that Ee is singular at (see |[M2|] pages 342-343) 
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Let A C be the diagonal, let pi : ^ C he the projection onto the i-th factor and let 
uj^,2 be the canonical sheaf of C^. Then — Pi^q ® pI^uj-^ and we have Kiinneth's isomorphism 
H^{&,uj^2) = H^{C,uq)^'^. Let hiC) C S'^H%C,ujq) C H%C,uq)^^ = H^^&.u^^) be the 
vector space of quadratic forms vanishing on the canonical image kC* of C. Fix an embedding 
H^{C'^ ,uj^2 ® C'^2(~2A)) C i/°((7^, wga) obtained by multiplication by a nonzero global section of 
(9g;2(2A) (note that hP{C'^ ^O^^i'^^)) = 1 because A has negative self- intersection, hence any two 
such embeddings differ by multiplication by a constant). Then it is easily seen that 

Similarly fix embeddings i/0(C2,cu^2®O^2(-2A-2A')) C H%C^,uj7,2®0^2{-'2^)) C H^{C^, 



Og;2(— 2A + 2A')). For E' G H' such that h'^{C,E) = 2, the linear system \E\ has no base points 
and E ^ a*E, it is well-known (see, e.g., [|ACGH|| page 261) that qe := Une\E\{D) = UDeW*E\{D) 
is a quadric of rank 4 whose rulings cut the divisors of \E\ and \o'*E\ on C. We need the following 

Lemma 2.3. 1. We have 

p*Op{2E) = uj^2 ® Cg2(-2^ + 2A'), 
pTo C h{C) C H''{C\u^2 ® (^c2(-2A)) c H%C\u^2 ® 0^2h2A + 2A')) , 

and 

pToo C hiC) n H\&,u^2 ® (-2^ - 2A')) C H\C\ljq2 ® C52(-2A + 2A')). 

2. For any s G Tq, let q{s) be the quadric in \uJg\* with equation p*s G I2{C). Then, in C"^ , the 
zero locus of p*s G H^{C'^,u^2 ® Cg;2(-2A + 2 A')) is 

Z{p*s) = Zq^s)+2A' 

where Zg^g) is a divisor with support 

{{p,q) e& -.{p + q) d q{s)}. 

If s & Tq is general, then ^g(s) is reduced. If Z{s) = Ee + 'Ea*E for some i? G S' such that 
h°{C, E) = 2, then q{s) = qE := Une\E\{D). 

3. If s eTo\ Too, then 

q{s) n (PToP = \uJc ® an C PTo^<5 = {lo^I* 

is the projectivized tangent cone tz{s) to Z{s) C P at 0. 

4. For any s G Tq, the multiplicity of p*s at the generic point of A' is even > 2 and if p*s vanishes 
on A' with multiplicity > 4, then either s G Too or tz{s) contains the Prym- canonical curve 

xc. 

Proof : H. Let E be an invertible sheaf of degree 2^' — 2 on C such that h^{C, E) =2 and \E\ has 
no base points. Let si and S2 be two general sections of E. Then 

si®S2-S2®sie A^H\C, E) C H\C, Ef 



and, as in the the proof of Lemma 2J., it is easily seen that Z[si ® $2 — S2 ® si) = De + A. 
Now, supposing that E ® a*E = uj^, from the natural map 



iPe : H%C, E) ® H%C, a*E) — ^ H\C, 



C' 
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we obtain the map 



ti®t2® a*ui a*U2 I — > i/jEih ® a*ui) ipEih ® a*U2) 



which induces the map 



bE : A^H^iC, E) ® A^H^iC, a*E) — > S^H^{C, 



c 
Put 

t := (si ® S2 — S2 ® Si) ® (cr*Si ® a*S2 — cr* S2 ® cf* Si) 

then Z{(l)E{t)) is in the hnear system \uj^2 \ and is equal to + A + -Do-*e + Hence De + D^*e 
is in the hnear system \uq2 ® C^2(^2A)|. 

If s e To is such that Z(s) = S^ + So-*^;, then, by Lemma p?T|, we have Z{p*s) = De + D„*e + '^^' ■ 
So Z(p*s) - 2A' = - 2A and p*Op{2E) ^ ® Og.,{-2A + 2A'). Since - 2A' = 

-2A, the section p*s of p*Op(2S) O Cg;2(-2A') = O Cgja (-2A) is a nonzero constant 
multiple of (pE^t) G /2(C') C H^{C'^,uj^,2 ® C^(72(— 2A)). Since such s generate Fq, this proves that 
p*ro C hiC). The rest of part |T] easily follows now. 

1. Let s and E be as above and suppose furthermore that E ^ a*E. With the above notation, 
let Xi, X2, X3, X^ be the images of, respectively, 

Si ® a*Si, S2 ® Cr*Si, Si ® (T*S2, S2 ® (T* S2 

by the map -i/^^;. Then = ^1X4 — X2X3. By, e.g. |[ACGH|| page 261, the polynomial — 

is an equation for qe- Therefore, since p*s is a constant nonzero multiple of (psit), we 
have = qe- By continuity, for all s' such that ^(s') = Em + So-.jv/ for some M G S' with 
M) = 2, we have q(s') = qm- 
A line is in qe if and only if it is in a linear space of one of the two rulings. Therefore a secant 
{p + q) to kC is in qe if and only if /i°(C', £; ® 0^{-p - g)) > or /i°(C7, ® - g)) > 0. 

Hence 

De + I^a-i? = {(p, g) : (j5 + C gs} = = Zg(^) 

and is a reduced divisor in this case. Hence Zq(^s) is reduced for general s G Fq. Now the rest 
of part 1^ follows by linearity. 

3. When i? is a smooth point of S', the intersection qe H PTqP = 2WTe'E' is the projectivized 
tangent cone at to S^; + E^^e (see |[M2|| pages 342-343). Hence ^ also follows by linearity. 



4. This immediately follows from the facts that p*s G /2(C) C S'^H^{C,uj^) C if°(C^, a^^a) and 
that xC is the tangent cone at to S. 

□ 

3. More divisors in |2E:|oo 
For any M G Pic^-^C, let Q^*m be the translate of 6 by 7r*(K (g) /9 (g) M"^), i.e., 

e^.M := {E G Pic^^-^C : /i°((7, £; ® 7r*M) > 0} . 

We have 

Proposition 3.1. The divisor P.Qt^*m is in the linear system |2E!|. It is in |2S|o if h^{C,M) is 
positive. 
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Proof : We first prove that all the divisors P.Qtt* m are linearly equivalent as M varies in Pic^~^C. 
Let ■0 : JC Pic^P be the morphism of abelian varieties which sends M (S) (3~^ to 
Op{P.Qt,*m — P-Q) G Pic^P. For C general, the abelian variety JC is simple, hence, since its 
dimension is not equal to the dimension of Pic^P, the morphism i/j is trivial, i.e., its image is Op. 
By continuity, this is the case for all C. Therefore, since P.Q = 2S, all the divisors P.Qt,*m are 
linearly equivalent to 2S. The second assertion is now immediate. □ 

Proposition 3.2. The divisor P.Q -^t^^j is an element o/ |2S|oo ifh^{C,M) > 2. 

Proof : We prove the Proposition in the case where hP{C, n*M) = 2 and it will follow in all cases 
by semi- continuity. By, e.g. |jACGH|| page 261, the tangent cone to Qt^'M at is the quadric q-rr'Ai '■ = 
^s&\7r*M\{S) in \uj~\* = FTqJC. Let vr also denote the projection FTqJC = \uq\* \uc\* = FTqJC 
with center \u!c ® a|* = PTqP. Since qn*M = '^*{qm) = '^*{^5e\M\{S)), we see that qn*M contains 
PTqP C FTqJC and the multiplicity of P.Qt^*m at is at least 3. Since this multiplicity is even, we 
have P.Qt,*m € |2S|oo. □ 

4. The base locus of L|g 

In this section we prove Proposition ^ and Theorem 0. Recall that we have assumed C to be 
non-hyperelliptic. We have 

Proposition 4.1. If M E Pic^-^C is such that h%C,M) = h\C,TT*M) = 2 and \M\ and \ujc ® 
M~^\ contain reduced divisors, then 

p*{P.e^*M) = Dm + D^^^M-^ + 4A' 
where Dm is the reduced divisor with support 

{{p, q) : h\C, M ® Oc{-np - vrg)) > 0} . 

Proof : First note that P.O^.j\,/ does not contain S. Indeed, for general points p and q in C, we 
have h^{C, tt*M (g) Og{p + q)) = 2 and h°{C, n*M (g) O^i-ap - aq)) = 0. Therefore p and q are 
base points for \7r*M 0^{p + q)\ and h^{C, 7r*M O Oq{p + q - ap - aq)) = 0. 

Now note that p*{P.Qt,*m) — 4 A' is effective because, by Proposition R]^, the divisor P.Q^^^m 



has multiplicity at least 4 at the origin. Then, using Lemma |2.3| , Proposition |3.1| and [ PH|| page 
287, one easily computes that p*{P.Qt,*m) — 4A' and Dm + D^^^m-'^ have the same cohomology 
class. It is therefore sufficient to prove that the support of p*(P.9^.m) — 4A' contains the support 
of Dm + -DoJc^M-i- By definition the support of p*{P.Qt,*m) is the set 

{{p, q) : h^{C, n*M ® + q - ap - aq) > 0} 

which, by Riemann-Roch, Serre Duality and the isomorphism uj^ = ti*ujc, is equal to the set 

{(p, q) : h\C, t:*{uc ® M-^) ® O^iap + aq - p - q) > 0} . 
Therefore the support of p*{P.Qt,*m) contains the union of A' and the sets 

{{p, q) : /i°(C, M ® Oci-np - nq)) > 0} 

and 

{{p, q) : h\C, uc ® M-^ ® Oc{-t^P - vrg)) > 0} . 

□ 

The following implies Theorem 13 
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Proposition 4.2. The inverse image by p of the support of the base locus of L\:^ is contained in 
the set of elements {p, q) of such that {np + nq) is contained in the intersection of the quadrics 
containing the canonical curve kC . In particular, if C is not trigonal, then the base locus of L does 
not intersect S. 

Proof : Let Wg_i be the subvariety of Pic^~^C parametrizing invertible sheaves with h^{C, M) = 
2. By Proposition |3]^ the base locus of L|g is contained in S fl (riMeW^ ^^7^{P-^tt*m)^ where 
e;i(P.e^.M) = e*(P.e^.M) - 4:8. We have p* {e-^PBir* M)) = p*{P.Q^,m) - 4A'. It immediately 
follows from Proposition ^?T| that the inverse image p* [p^Mew^ ^^^^{.P-^-k*m)^ is supported on the 

set of elements {p,q) of & such that {up + vrg) is contained in qM for all M e ^l-v Since the 
quadrics of the form qu generate |/2(C')| (see Q and [|S"V|] ) and the base locus of |/2(C')| in the 
canonical space \ojc\* does not contain any secants to kC for C non-trigonal (see ||ACGH|] page 124), 
the proposition follows. □ 

Remark 4.3. For C trigonal, (-P, S) is the jacobian of a curve, say X. Then, using the set- 
theoretical equalities Vqo = X — X and l^„/,oo = ^t^; one can show that the inverse image by p of 
the support of the base locus of L\-^ is equal to the set of {p,q) G such that {np + nq) is contained 
in the intersection of the quadrics containing the canonical curve kC . 

Let 

be the map which to s G Fg associates the quadric term of its Taylor expansion at 0. Then T2 is onto 
because its kernel is Foo which has dimension 2*^ — 1 — \p{p + 1) = dim(Fo) — /i°(PToP, Opr(,p(2)). 
We have 

Lemma 4.4. For s G Fq, 

s G Foo ^ q{s) D PTqP . 

Proof : By Lemma ^]3| part and with the notation there, if s G Fq \Foo, then Tz{s) = (?(s) flPTo-P- 
So the projectivizations of the two maps T2 and s ^ (p*s)|proP G /2(C')|ptoP are equal. Hence, there 
exists A G C* such that, for every s G Fq, we have Xt2{s) = {p*s)\f>Top. So 

s G Foo ^ r2{s) = ^ (p*s)|ptoP = ^ q{s) D PToP . 

□ 



Let 12(0, a) be the subvector space of /2(C) consisting of elements which vanish on PToP- By 
the above lemma and because all elements of Fo are even, the map p* sends Foo into the subspace 
12(0, a)^ of cr-invariant elements of l2{C,a). We have 

Lemma 4.5. The subspace /2(C, a)"*" is equal to hiC) C hiC)- 

Proof : The cx-invariant and a-anti-invariant parts of H^{C,uj~) are, respectively, H^{C,ujc) and 
H^{C,uJc ® «). Therefore in the decomposition 

S''H%C, uq) = S^H%C, uc) © H%C, toc) ® H%C, uc a) ® S^H%C, uc ® a) 

the space S^H^{C, ujc) © S^H^{C, uc © a) is the a-invariant part of S^H^C, u^). So S^H^C, uc) 
is the subspace of cr-invariant elements of S'^H^{C, u^) which vanish on PTqP. Therefore l2{C, a)~^ 
is contained in S'^H^{C, loc) and hiC, a)^ is the subspace of elements of S'^H^{C, ujc) which vanish 
on kC. This is precisely l2{,C). □ 
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Corollary 4.6. The dimension o/Tq^ is at least 2"^ — 2 — p"^ + p and at most 2^ — 1 — ^p{p + l) — 3 = 
2^ — 4 — ^p{p + 1). The codimension of Qqq in Qoo is at least 2. 

Proof : By Lemma [4.5| , we have Fqq = Ker(p* : Too — * hiC) C 12(C)). Hence the dimension of 
r'oo is at least dim(roo)- dim(/2(C)) =2^-1- lp{p+l) - - 2)(^ - 3) = 2^ - 1 - 1) - 

lip - l){p ~ 2) = 2P - 2 - p^ + p. 

To prove the upper bound for the dimension of Fqq, we prove that the dimension of p*roo is at 



least 3. For C non-trigonal, this is an immediate consequence of the result of Proposition [4 .21 which 



says that p*L has no base points and the fact that p*L has positive self-intersection number: this 



number is easily computed using Lemma and the calculation of the cohomology class of D^; on 
page 287 of 



Now suppose C trigonal. The linear system p*L contains the divisors p*{P.Qt^*m) — 4A' for 
M e ^l-i- Since g > 'b, the curve C has a unique linear system of degree 3 and dimension 1 
and we denote the associated invertible sheaf of degree 3 by Mq. Choose three general effective 
divisors A^, N' and A^" of degree ^ - 4 on C and put M = Mq ® Oc{N), M' = Mq ^ Oc{N') 
and M" = Mq ® Oc{N"). Let s, s' and s" be sections whose divisors of zeros are respectively 
P*(P.6^*m) - 4A', p*{P.Q^,M') - 4A' and p*{P.Qn*M") - 4A'. If a non-trivial linear combination 
of s, s', s" is zero, then the coefficients of at least two of s, s', s", say s and s', are non-zero. Then 
the restrictions of s and s' to p*{P-Qn*M") — 4A' have the same divisors. By Proposition [4.1| , we 
have p*(P.e^*M) - 4A' = Dm + D^^^m-^. Hence p*{P.Q^*m) - 4A' = Dm, + p\{ti* N) + pI{t:* N) + 
^a.c®M-i. Similarly p*{P.Q^,M')-^^' = Dm,+p\{t^*N')+pI{ti*N') + D^^^^m'-^ and p*(P.0^.M")- 
4A' = Dmo + pI{-k*N") + p*2{-k*N") + -D^p^M"-!- Let p be a point of C such that up is a point of 
N". Then := pl{p) ^ C is contained in p*{P.e^*M") - 4A'. Hence (p*(P.e^.Af) - 4A')|fp = 
(p*(P.e^*M') - 4A')|f,. Equivalents, (p^(7r*iV) + D^^^m-^)\f^ = (p^(7r*iV') + D^^.^^,-i)\f,. Since 
A^, A^', A^" are general, there are unique divisors, say G and G' in, respectively, \uc ® M~^\ and 
\u!c M'~ I containing irp. Then, after identifying Fp with C, the previous equality of divisors 
becomes tc*N + 'n-*G — p — ap = 'k*N' + 'k*G' — p — ap. Since A^' is general and G depends only on 
A^ and A^", this is not possible. Hence there are no non-trivial linear relations between s, s', s" and 
p*L is at least a net. 

In the non-trigonal case, the codimension of Qqq in Qqo is at least 2 because the restriction of 
p*L to A' has positive degree and no base points, therefore it is at least a pencil. In the trigonal 
case, use divisors as above to show that (/0*-L)|a' contains at least two distinct divisors. □ 

Remark 4.7. In case p = 4, the above gives a second proof of the result of |p^z2|] (page I48) saying 
that the dimension o/Fqq is 2. 
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